Potential and Flux Decomposition for Dynamical Systems and Non-Equilibrium 
Thermodynamics: Curvature, Gauge Field and Generalized Fluctuation-Dissipation 
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The driving force of the dynamical system can be decomposed into the gradient of a potential 
landscape and curl flux (current). The fluctuation-dissipation theorem (FDT) is often applied to 
near equilibrium systems with detailed balance. The response due to a small perturbation can be 
expressed by a spontaneous fluctuation. For non-equilibrium systems, we derived a generalized FDT 
that the response function is composed of two parts: (1) a spontaneous correlation representing the 
relaxation which is present in the near equilibrium systems with detailed balance; (2) a correlation 
related to the persistence of the curl flux in steady state, which is also in part linked to a internal 
curvature of a gauge field. The generalized FDT is also related to the fluctuation theorem. In the 
equal time limit, the generalized FDT naturally leads to non-equilibrium thermodynamics where 
the entropy production rate can be decomposed into spontaneous relaxation driven by gradient 
force and house keeping contribution driven by the non-zero flux that sustains the non-equilibrium 
environment and breaks the detailed balance. 



The global stability is essential in understanding the 
dynamical non-equilibrium systems. The driving force 
of the dynamical system often is not integrable and can 
not be written in terms of the gradient of a potential. 
The driving force however can be decomposed into the 
gradient of a potential and a curl flux (current) fl|. The 
potential is related to the steady state probability and 
the gradient force gives the normal dynamics analogous 
to equilibrium system, while the curl flux force is di- 
rectly linked to the non-equilibrium contribution from 
detailed balance breaking. For non-equilibrium dynam- 
ics, the dual description with both potential and flux is 
necessary. 

In addition, the fluctuation-dissipation theorem (FDT) 
plays a central role for systems in near equilibrium sys- 
tems with detail balance It links the fluctuations of 
the system quantified by the correlation function with the 
response of the system quantified by the response func- 
tion. Many efforts have been made to extend the FDT 
to non-equilibrium systems It was found that the 
FDT involves the correlation function of a variable that 
is conjugate with entropy ^ITj . Furthermore, by choosing 
proper observables, the FDT for non-equilibrium systems 
can be uncovered jl8|. 

In this letter, we found another way to generalize FDT 
for non-equilibrium processes, specifically for direct ob- 
servables such as Xi, under Markov dynamics in contin- 
uous space described by Langevin dynamics or Fokker- 
Planck equations. Particularly, the response function can 
be split into two parts. One is from the correlation of 
the observable itself representing the spontaneous relax- 
ations, which also exists in systems with detailed bal- 
ance. The other one relates to the heat dissipation in the 
medium, representing the detailed balance breaking con- 



tribution, which directly links to the curl fiux part of the 
force. On a closed loop, the medium heat dissipation can 
be described by the internal curvature introduced by the 
non- gradient force or curl flux part, which is analogous to 
Abelian Gauge Theory [l9l |. On any particular path, the 
medium heat dissipation is analogous to the Wilson lines 
of Abelian gauge theory ,19] . In the equal time limit, the 
generalized FDT naturally leads to non-equilibrium ther- 
modynamics (20l - [2^ . In addition, this generalized FDT 
is also related to Fluctuation Theorem [23-28]. 

Markov dynamics in continuous space can be charac- 
terized by Langevin equations: 



F,;(x) + B,,(x)ej(0 



(1) 



where F,; (x) is the driving force and (t) is the Gaussian 
distributed white noise: {^i{t)^j{t')) = S{t - t'). Here 
the Einstein notation is used: when an index i appears 
twice in a single term, it implies that we are summing 
over all of its possible values. The probability obeys the 
Fokker-Planck equation: 



P(x,i) =L(x)P(x,t) 



(2) 



and 



with the operator L(x) — 

the diffusion coefficient D 
venience, we use 9, 

the time dependent probability distribution and P^^{x) 
to indicate the time independent steady state probability 
distribution. The flux can be defined as: 



- diFiix) + didjDij{x) 

,;(x) = i(BBT),j.(x). Forcon- 
P(x) = P{x,t) to represent 

SS/ 



F,(x)P(x) + Aj(x)a,P(x) = ji(x) 



(3) 



where Fi — Ft —djDij. Then Fokker-Planck equation can 
be rewritten as '^^^^'^'^ — d ■ The system is considered 



2 



to be in detailed balance if the steady state flux: 
- f'.(x)P««(x) + A,(x)a,P^^(x) = jf ^(x) 



(4) 



tss 



0. For general non-equilibrium systems 
without detailed balance: j'^'^ ^ 0, the steady state flux is 
a divergence free vector with d ■ = 0. The force term 
Fj(x) can be decomposed into two parts: a potential gra- 



dient term — (x)^-J7(x) where U{x.) 



InFs.(x) 



and flux term —jj^{x)/P^^{x) = —Vj{x), with a proba- 
bilistic velocity: Wi(x). Alternatively, the gradient of po- 
tential — InP'^'^(x) can also be decomposed into a force 
term and a curl flux term : 



.,ss 



(x)] (5) 



5F=0 



(7) 



(8) 



Using perturbation theories, FDT for equilibrium sys- 
tems with detailed balance was investigated Here 
we will extend it to non-equilibrium systems. Consider 
a linear perturbation on the force: Pi(x) — > ^/(x) = 
Fi(x) + h{t)SFi{x), we have L ^ L' = L ~ h{t)SL, with 
6L = SFi{x.)di + di6Fi{x.). The probability evolves as 

P(x,t) = exp\ dt{L - h,{t)dL)\p{x,t') (6) 
S{n{t)) = {n{t)) - ==/dxl7(x)[P(x,t) -P^^(x)] 
Therefore, for t > t' , the response function reads as 
R^{t-t') = 5{n{t))/Sh{t') 

dxn(x)e^(*-*') (-(5L)P^^(x) 

Using the decomposition in equ. ([5]), we have 

R?it-t') 

dxr!e^(*-*'){5Pa-^fc - vf]D-^^ - d,SF,}P^^ 

= ^{nmSF.it')) - [{n{t)5F,it')Fkit')D7^\t')} 

+ {mSFit')vi'it')D7^\t')} 

This is the general relation between response functions 
and correlation functions. Here, the correlation be- 
tween two observables f2^ and fi^ is C s-}^ {t' , t) = 

{f2^t')n^{t)) - {[2Ht')){[2Ht)) with {n^{t')[2Ht)) = 

Pssiyi')nl^,nl,P{x\t'\x.^ ,t). P(x',t'|x%i) is the tran- 
sition probability from initial state x' at time t' to final 
state x-* at time t. For the perturbation independent on 
x: 5Fi = 1, we obtain 

Rf{t-t') = -{nmMP''{m (9) 
= - '{n{t)F,{t')D7^\t')) + {n{t)vf{t')D7^'{t'))_ 

which is a generalized FDT for non-equilibrium systems 
2l| . With the force decomposition in equ. the re- 
sponse of the system is composed of two terms. The first 
term, just as equilibrium cases, is related to the usual 



correlation of the variable with the driving force. This 
term exists even for FDT of equilibrium systems obeying 
the detailed balance (this is the case where the gradient 
of the logarithm of probability is equal to the driving 
force). The second term however is directly related to 
the non-zero flux which violates the detailed balance and 
measures the degree of the non-equilibrium-ness (how far 
away the system is from equilibrium). 

FDT in equ. ^ can also be generalized to the case 
that the system is not prepared in steady state but an 
arbitrary distribution P(x). For t >t' , we have 



{~6L)P{x) (10) 



Choose the observable D, = Vi and sum over i from equ. 
()10p . the response function in equal time limit t ^ t' is: 



dx[a-j(x)]lnP(x) 



^ — / dxP(x)lnP(x) = -5 
at J 

{v,{t)Fk{t)D;,\t)) + {v.{t)vk{t)Dr^\t))] (11) 

Then, the Gibbs entropy S = - f d(x)P(x) In P(x) has 
two parts: 



RTit)^ / dxu,(x)h9,P(x)] 



= {v^Dr\^) + {v,D-^F,)^ep-S, 



(12) 



Bp > is the average entropy production rate of the sys- 
tem and TSm — (Tsm) is the average heat dissipation in 
the medium. The rate of heat dissipation in the medium 
is g = FiijD^-^ — Tsm, where the exchanged heat q is 
identified with the increase of entropy Sm in the medium 
of temperature T [2l[ . S links with the gradient of the 
time dependent probability distribution: VP, which is 
composed of two terms. One is from the bulk entropy 
production of the system which links with the flux v and 
the other is from the heat dissipation into the medium 
(surface) which links with the driving force F 2l|. We 



see that the driving force for entropy production is the 
flux. With the detailed balance, only the time dependent 
flux contributes to entropy production. While without 
detailed balance, entropy production has both time de- 
pendent and steady state flux contributions. We would 
like to separate the contribution of time dependent and 
independent entropy production of the system and re- 
late that to the relaxation of time dependent probability 
and steady state flux explicitly. Therefore, if we take the 
observable il = 
function in equ. 

(vidi In 



,ss 



and sum over i, the response 
T0|) with equal time limit t = t' gives: 



P^^(X)/P(X) ) = Ffree/T 



{vf^Dr^v,) - {v.Dr^S) = Qhk/T - (13) 
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I) 



It leads to Te 
T(ln 

Te. 



p 



Q/ife - Ffree with free energy Ffree 
U — TS, the house keeping heat Qhk 



- T{vfHt)vf{t)D-/{t)) = 

-p Ffree = TSm + U and total energy [/ = 
—T J d xP(x) In fP'^'^ (x)] , which was given in previous lit- 
erature [20|422| • The change of the total internal energy 
is [> = T(z;,(t)9iln[P-5-5(x)]). There are two different 
origins of the total entropy production Cp. Ffree is from 
spontaneous non-stationary relaxation which links with 



P(x) 



Qhk is 



the gradient of relative potential —di In 
the driving force necessary to sustain the non-equilibrium 
environment, which links with the steady state flux 
v'^'^(x). For the non-equilibrium steady state, Ffree = 0. 
Qhk equals the medium dissipated heat for maintain- 
ing the violation of detailed balance: Qhk = TSm = 
—T{vf^D~j^Fj}. For detail balanced cases, Qhk = and 
total entropy production of the system equals the spon- 
taneous relaxation of free energy Tcp — —Ffree- Here 
we found that the generalized FDT in the equal time 
limit t' = t naturally leads to non-equilibrium thermo- 
dynamics with total entropy production from both non- 
stationary spontaneous relaxation and stationary house 
keeping part. This is our first main result. 

In addition, we can relate the non-equilibrium Fokker- 
Planck equation with Abelian Gauge Theory and in- 
ternal curved space, as in Quantum Electrodynamics 
(QED)^^. With the covariant derivative = di — 
D^j^Fj = di + Ai, Fokker-Planck equation can be rewrit- 
ten as: Dij{x.)VjP{x.) — ji{x.). The curvature of internal 
charge space due to the Abelian gauge field Ai is: 



Rij = diAj-djA, = [Vi,Vj]. 



(14) 



where [■] indicates a commutator of two operators. Ac- 
cording to equ. dH), for the detailed balance case: j'^'^ = 
0, Ai = di ln(P'^'^) is a pure gradient and the curvature 
is zero: Rij = which corresponds to a flat space. While 
for non-equilibrium cases, A can't be written as a gradi- 
ent and Rij ^ which corresponds to a curved internal 
space. Rij is gauge invariant tensor: for a gauge transfor- 
mation Ai ^ Ai + di(j>, Rij — )■ R'^j = Rij. Furthermore, 
the probabilistic velocity v(x, f) and the flux j(x, t) are 
also related to this internal curvature as: 



R 



(15) 



or in the case of constant diffusion coefficient Dij = D6ij : 
diVj — djVi = Rij. We noticed that equ. (fTSi) is also gauge 
invariant. It means if we change Ai — >■ Ai + d(j), although 
P(x, t), v(x,t) and j(x, t) are all changed, equ. P3t is 
always satisfied with a same curvature Rij. Moreover, 
even v(x, t) and j(x, t) depend on the solution of P(x, t), 
they always satisfy equ. (fTSj) . either for steady state so- 
lutions or time dependent solutions. So Rij represents a 
measurement of internal geometry of the non-equilibrium 
dynamics. This curvature of internal space relates to the 



the heat dissipation in the medium along closed loop. 
Along any specific path x(i), TAsm is the heat dissipa- 
tion in the medium: 

TAs„,(x'(i'),x(i)) -T^^ smdt (16) 
= / Dr/{^{t))Fj{^{t))i,dt = - f A,{x{t))dx,{t) 



Using the Stokes 's theorem and the current definition in 
equ. dS]) , the entropy increase of the medium Asm along 
a close loop C can be written as: 



TAst 



A,{x)dx, = - i D,^^\x)v^'^ix)dxi 

J (J 



-- I daijRij 



(17) 



where E is the surface of the closed loop C, daij is the an 
area element on this surface, and Rij is the curvature due 
to the gauge field A. Both the curvature Rij and the close 
loop heat dissipation in the medium TAs^ are gauge 
invariant under gauge transformation Ai Ai + di4>. 
Thus, we related non-equilibrium dynamics to an internal 
curved space. The presence of the non-zero flux destroys 
the detailed balance, leads to non-zero internal curvature 
and a global topological non-trivial phase analogous to 
quantum mechanical Berry phase |H . This is our second 
main point. 

The medium heat dissipation Asm in equ. (|16p plays 
an important role in the time irreversibility for non- 
equilibrium systems 2l|, |23|, |24| . We will see it also gives 
an important contribution in generalized FDT for non- 
equilibrium dynamics and such contribution links with 
this gauge field and internal curvature . 

In the following, we will focus on cases of constant dif- 
fusion coefficients Dij for simplicity. If j = 0, it is the 
equilibrium system with detailed balance, which has time 
reversal invariant: (f7(t)Pj(x(t'))) = (P,-(x(i))f7(i')). 
Using the Langevin equation ([ij, (Pj(x(i))f7(t')) = 
{[xi{t) — S^i{t)\n[t')) — {xi{t)Q{t')) , since random force 
will not correlate with 51 of previous time {t > t'): 
{^,{t)fl{t')) = 0. Then, we arrive at: 



PP(t-t') 



-D 



ik 



r d 

di 



'xkmit')) 



In particular, for the operator f2(x) = Xj, we see 



R^,'{t-t') = -D. 



-{Xk{t)x,{t')) 



(18) 



(19) 



which is the FDT near equilibrium Q. 

However, if the system is in non-equilibrium state, 
there is no detailed balance: j 7^ 0. We are often more 
interested in the direct observable Xi and a FDT as 
the form of equilibrium case as in equ. ()19p . in which 
we can split out the correlation {xk{t)xi{t')) . With- 
out detailed balance, the system is time irreversible: 



4 



{n{t)Fj{x{t'))) ^ (^i(xli)M<'))- According to the 
Fluctuation theorem [21, [23, 24|, we have 



In 



pSS(x)P(x',t|x,t') 



= Ai 



(20) 



with P(x,t|x',i') (P(x', t|x, i')) the probabilities of a 
forward (backward) path. We define (17(t)Fj(x(i'))) — 
(Fj(x(t))l](t')) = /dxdx'f7(x)F,(x')A(x,x',t-i') with 



y4(x,x',t - t') 
P^^(x')P(x,t|x',t') 



(21) 



P^^(x') / i^[x]P(x,i|x',t') 1 



P^'^(x)P(x',t|x,t') 

pSS 



pss(x') 



Z)[x] is the path integral from x'(t') to x(t). Then, we 
get 



R'^{t-t') = -D-^\-{xum{t')) 



-^ik J dxdx'n{x)Fk{x')A{x, x', t - t') 



(22) 



For the operator f2(x) = Xj, the response function reads 
d 



dt 



{Xk(t)x,{t')) 



-DT-j} J dxdxxjFk{x)A{x, x, t - t') 

-DT^\x,{t)vi^{t')) (23) 

The first term is similar to the equilibrium case in equ. 
([T9l) . The last two terms in equ. ([23|) are zero for de- 
tailed balance case. These two terms are related to the 
internal curvature due to the gauge field in space, as 
shown in equ. and ((TT)) . In equ. ((2T|) . the fac- 

tor U{x,y) = e^^^"^ — Ip Ai(x)dxi ygj.y similar to 
the Wilson loop or Wilson line in Abelian gauge theory, 
with Jp indicating the integral for a path from x to y 
[l9| . It describes the irreversibility determined by the 
heat dissipation in the medium. The function inside the 

path integral of equ. ^ is U{x,y) p^^aff) = e"'^«"/^, 
where Aq^k is the housekeeping heat along a trajectory. 



2l| . Along a closed loop. 



It was proved (e '^9'!'=/^) = 1 
Q~^ihk/T _ U{x,x). Under the gauge transformation, 
U{x,y) transforms as: U{x,y) e^^^^U{x,y)e~'^^y\ It 
also satisfies the differential equation: 

x,y,U{x,y)^0 (24) 

It means that the gradient of phase factor (Wilson lines) 
contribution from the heat dissipation or house keeping 
part for non-equilibrium systems is perpendicular to the 
dynamics just as the case in the circular motion. The 
origin of the non-zero curvature is the non-zero flux which 



breaks the detailed balance for non-equilibrium systems. 
This is the third and last main result of the paper. 
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